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Previous  studies  demonstrated  that  brain  signals  encode  information  about  specific  features  of  simple  auditory 
stimuli  or  of  general  aspects  of  natural  auditory  stimuli.  How  brain  signals  represent  the  time  course  of  specific 
features  in  natural  auditory  stimuli  is  not  well  understood.  In  this  study,  we  show  in  eight  human  subjects  that 
signals  recorded  from  the  surface  of  the  brain  (electrocorticography  (ECoG))  encode  information  about  the 
sound  intensity  of  music.  ECoG  activity  in  the  high  gamma  band  recorded  from  the  posterior  part  of  the  superior 
temporal  gyrus  as  well  as  from  an  isolated  area  in  the  precentral  gyrus  was  observed  to  be  highly  correlated  with 
the  sound  intensity  of  music.  These  results  not  only  confirm  the  role  of  auditory  cortices  in  auditory  processing 
but  also  point  to  an  important  role  of  premotor  and  motor  cortices.  They  also  encourage  the  use  of  ECoG  activity 
to  study  more  complex  acoustic  features  of  simple  or  natural  auditory  stimuli. 
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Introduction 

The  neural  substrates  underlying  the  processing  of  complex  sounds, 
such  as  voice  or  music,  have  not  yet  been  fully  elucidated  (Griffiths 
and  Warren,  2004;  Kumar  et  al.,  2007;  Leaver  and  Rauschecker,  2010; 
Zatorre  et  al.,  2004).  Many  studies  on  music  perception  and  auditory 
processing  have  focused  on  the  low-level  acoustic  features  that  compose 
complex  sounds.  For  instance,  loudness  perception  was  found  to  be  cor¬ 
related  to  temporal  acoustic  features  (e.g.,  sound  intensity)  within  an  au¬ 
ditory  stream  (Platel  et  al.,  1997;  Reiterer  et  al.,  2008;  Zatorre  and  Belin, 
2001 ).  Auditory  processing  of  these  acoustic  features  (i.e.,  sound  intensi¬ 
ty)  has  been  extensively  studied  using  functional  magnetic  resonance 
imaging  (fMRI),  positron  emission  tomography  (PET),  and  scalp- 
recorded  electroencephalography  (EEG).  These  studies  have  identified 
cortical  representations  of  sound  intensity  processing  mainly  in  the  pri¬ 
mary  and  secondary  auditory  cortices  (Jancke  et  al.,  1998;  Langers  et  al., 
2007;  Mulert  et  al.,  2005).  fMRI  (Jancke  et  al.,  1998;  Langers  et  al.,  2007) 
or  combined  fMRI/EEG  studies  (Mulert  et  al.,  2005;  Thaerig  et  al.,  2008) 
found  a  linear  relationship  between  blood  flow  or  electrical  activity  in 
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the  primary  auditory  cortex  and  sound  intensity  level.  Other  studies 
(Brechmann  et  al.,  2002;  Hart  et  al.,  2003;  Tanji  et  al.,  2010;  Yetkin  et 
al.,  2004)  showed  a  relationship  between  sound  intensity  and  the  spatial 
extent  of  BOLD  activations  in  the  auditory  cortex. 

All  these  studies  investigated  brain  responses  to  specific  static  fea¬ 
tures  of  simple  auditory  stimuli.  Despite  this  body  of  work,  it  has  been 
unclear  to  what  extent  brain  signals  encode  dynamic  acoustic  features 
(such  as  the  time  course  of  sound  intensity)  in  a  continuous  stream  of 
music.  Functional  neuro imaging  techniques  (e.g.,  fMRI  or  PET)  depend 
on  metabolic  processes  (such  as  the  hemodynamic  response)  and 
therefore  measures  signals  that  are  produced  by  neuronal  mass  activity 
(Logothetis,  2008).  These  techniques  cannot  readily  differentiate  be¬ 
tween  different  underlying  physiological  processes  (such  as  local  corti¬ 
cal  processing  vs.  large-scale  oscillatory  activity)  and  have  low  temporal 
resolution  (Aine,  1995;  Shibasaki,  2008).  On  the  other  hand,  EEG  re¬ 
cordings  provide  electrophysiological  measurements  with  high  tempo¬ 
ral  resolution,  but  cannot  capture  local  cortical  processing  that  is 
reflected  in  high  frequency  field  potentials,  and  also  suffer  from  low 
spatial  resolution  (Nunez  and  Srinivasan,  2005).  For  instance,  a  recent 
EEG  study  by  Schaefer  et  al.  (2010)  was  able  to  differentiate  seven  dif¬ 
ferent  musical  fragments  based  on  single-trial  event-related  potentials. 
However,  they  could  not  accurately  localize  functionally  significant 
areas  due  to  the  low  spatial  specificity  of  scalp  recordings. 

Electrocorticographic  (ECoG)  recordings  from  the  surface  of  the 
brain  combine  high  temporal  resolution  with  relatively  high  spatial 
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resolution.  ECoG  activity  in  the  high  gamma  range  (i.eM  -70-170  Hz)  is 
generally  regarded  as  an  accurate  indicator  of  local  cortical  processing. 
For  example,  ECoG  has  been  found  to  reflect  higher-order  auditory  pro¬ 
cessing  (Boatman-Reich  et  al.,  2010;  Crone  et  al.,  2001;  Edwards  et  al., 
2005, 2009;  Sinai  et  al.,  2009)  and  aspects  of  speech  or  auditory  percep¬ 
tion  (Crone  et  al.,  2001;  Edwards  et  al.,  2009;  Lachaux  et  al.,  2007; 
Pasley  et  al.,  2012;  Ray  et  al.,  2003;  Sinai  et  al.,  2009).  Nevertheless, 
which  ECoG  features  and  locations  encode  dynamic  aspects  of  acousti¬ 
cal  features  in  continuous  music  has  remained  unknown. 

The  goal  of  this  study  was  to  determine  the  ECoG  features  and  the  cor¬ 
tical  regions  that  are  related  to  sound  intensity  of  continuous  music.  Our 
results  from  8  human  subjects  demonstrate  for  the  first  time  that  ECoG 
high  gamma  activity  recorded  from  auditory  and  premotor  and  motor 
cortices  accurately  reflect  the  time  course  of  the  music's  sound  intensity. 

Materials  and  methods 

Subjects  and  data  collection 

The  subjects  in  this  study  were  eight  patients  with  intractable  epi¬ 
lepsy  (4  women  and  4  men)  who  underwent  temporary  implantation 
of  subdural  electrode  arrays  for  the  purpose  of  localization  of  seizure 
foci  prior  to  surgical  resection.  Table  1  summarizes  the  subjects'  clinical 
profiles.  All  of  the  subjects  gave  informed  consent  to  participate  in  the 
study,  which  was  approved  by  the  Institutional  Review  Board  of  Albany 
Medical  College.  Preoperative  Wada  testing  (Wada  and  Rassmussen, 
1960)  determined  language  lateralization  to  the  left  hemisphere  in  sub¬ 
jects  A,  B,  C,  D,  E,  and  G;  and  bilateral  language  dominance  in  subject  F. 
Language  lateralization  was  not  determined  for  subject  H.  None  of  the 
subjects  had  a  history  of  hearing  impairment.  The  implanted  elec¬ 
trode  grids  (Ad-Tech  Medical  Corp.,  Racine,  WI)  consisted  of  platinum- 
iridium  electrodes  that  were  4  mm  in  diameter  (2.3  mm  exposed),  em¬ 
bedded  in  silicon,  and  were  spaced  with  an  inter-electrode  distance  of 
1  cm.  (The  temporal  lobe  grid  of  subject  F  had  electrodes  with  a  6  mm 

Table  1 

Clinical  profiles  of  the  subjects  that  participated  in  the  study.  All  of  the  subjects  had 
normal  cognitive  capacity  and  were  functionally  independent.  Language  lateralization 
(LL)  was  based  on  the  Wada  test. 


Subject 

Age 

Sex 

Handedness 

LL 

Seizure 

Grid  locations 

#  of 

focus 

elec. 

A 

24 

M 

R 

L 

Right 

Right 

64 

temporal 

fronto-parietal 
Right  temporal 

35 

B 

29 

F 

R 

L 

Left 

Left 

64 

temporal 

fronto-parietal 

Left  temporal 

23 

Left  temporal  pole 

3 

Left  occipital 

6 

C 

30 

M 

R 

L 

Left 

Left  frontal 

40 

temporal 

Left  temporal 

35 

Left  temporal  pole 

4 

Left  occipital 

4 

D 

26 

F 

R 

L 

Left 

Left  frontal 

64 

temporal 

Left  temporal 

35 

Left  temporal  pole 

4 

Left  occipital 

6 

E 

45 

M 

R 

L 

Left 

Left 

54 

temporal 

fronto-temporal 
Left  temporal  pole 

4 

F 

29 

F 

R 

Bilateral 

Left 

Left  frontal 

40 

temporal 

Left  temporal 

68 

Left  temporal  pole 

4 

Left  orbital  pole 

4 

Left  occipital 

4 

G 

45 

F 

L 

L 

Left 

Left  frontal 

31 

temporal 

Left  temporal 

27 

H 

60 

M 

R 

NA 

Left 

Left  temporal 

17 

temporal 

Left 

parieto-occipital 

42 

Fig.  1.  Example  of  an  implanted  subdural  grid  in  Subject  B.  (A)  Lateral  radiograph  indicating 
grid  position.  (B)  Subdural  grid  placed  over  left  fronto-parietal  and  temporal  lobes. 

inter-electrode  distance.)  The  total  numbers  of  implanted  electrodes 
were  99, 96, 83, 109,  58, 120,  58,  and  59  for  subjects  A  to  H,  respectively. 
Grid  placement  and  duration  of  ECoG  monitoring  were  based  solely  on 
the  requirements  of  the  clinical  evaluation  without  any  consideration  of 
this  study.  Each  subject  had  postoperative  anterior-posterior  and  lateral 
radiographs,  as  well  as  computer  tomography  (CT)  scans  to  verify  grid  lo¬ 
cations  (see  Fig.  1). 

The  subjects  were  instructed  to  listen  attentively  to  the  song  “An¬ 
other  Brick  in  the  Wall  —  Part  1”  (Pink  Floyd,  Columbia  Records,  1979) 
while  ECoG  activity  was  recorded  using  the  general-purpose  software 
BCI2000  (Schalk  and  Mellinger,  2010;  Schalk  et  al.,  2004)  that  was  con¬ 
nected  to  eight  g.USBamp  biosignal  acquisition  devices  (g.tec,  Graz, 
Austria).  The  song  was  3:10  min  long,  digitized  at  44.1  kHz  in  waveform 
audio  file  format,  and  binaurally  presented  to  each  subject  using  in-ear 
monitoring  earphones  ( 12  to  23.5  kHz  audio  bandwidth,  20  dB  isolation 
from  environmental  noise).  The  sound  volume  was  adjusted  to  a  com¬ 
fortable  level  for  each  subject. 

ECoG  signals  were  referenced  to  an  electrocorticographically  si¬ 
lent  electrode  (i.e.,  a  location  that  was  not  identified  as  eloquent  cor¬ 
tex  by  electrocortical  stimulation  mapping),  digitized  at  1200  Hz, 
synchronized  with  stimulus  presentation,  and  stored  with  BCI2000. 
The  recordings  were  visually  inspected  offline  for  environmental  arti¬ 
facts  and  interictal  activity.  Channels  that  did  not  clearly  contain 
ECoG  signals  were  removed  from  further  analyses,  which  left  97,  86, 
82, 104,  56, 108,  57,  and  53  channels  for  subjects  A  to  H,  respectively. 

Cortical  mapping 

We  used  Curry  software  (Neuroscan  Inc.,  El  Paso,  TX)  to  create 
subject-specific  3D  cortical  brain  models  from  high-resolution  pre¬ 
operative  magnetic  resonance  imaging  (MRI)  scans.  We  co- registered 
the  MRIs  with  post-operative  computer  tomography  (CT)  images  and 
extracted,  for  each  grid  electrode,  the  stereotactic  coordinates  and  func¬ 
tional  area  according  to  the  Talairach  Atlas  (Lancaster  et  al.,  2000).  We 
used  the  3D  cortical  template  provided  by  the  Montreal  Neurological 
Institute  (MNI)2  for  cross-subject  analysis  and  for  subject  A,  whose  brain 
model  was  not  available.  Finally,  we  projected  the  electrodes  onto  the 
subject-specific  brain  models  shown  in  Fig.  2  to  render  activation  maps 
using  custom  MATLAB  software. 

Extraction  of  ECoG  features 

We  were  interested  in  the  spectral  amplitudes  of  the  ECoG  signals  in 
the  mu  (8-12  Hz),  beta  (18-24  Hz),  low  gamma  (35-45  Hz)  and  high 
gamma  (70-170  Hz)  bands  because  these  frequency  bands  have  been 
shown  in  previous  ECoG  studies  to  be  task-related  (e.g.,  motor  move¬ 
ment  Miller  et  al.,  2007;  Schalk  et  al.,  2007),  speech  production  (Pei  et 
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Fig.  2.  Subject-specific  brain  models  and  projected  electrode  locations  for  subjects  A  to  H.  (The  MNI  brain  was  used  for  subject  A  because  his  brain  model  was  not  available.) 


Fig.  3.  Example  of  ECoG  activity  and  its  relationship  with  sound  intensity  in  subject  B.  A:  Time  course  of  normalized  high  gamma  amplitudes  (blue  traces)  extracted  from  channels 
located  in  the  left  temporal  lobe.  B:  Locations  that  exhibit  a  time  course  that  is  correlated  with  sound  intensity  are  indicated  with  colored  symbols  and  are  shown  on  the  subject's 
brain  model.  C:  Magnification  of  time  course  of  sound  intensity  (black  trace)  and  high  gamma  of  the  indicated  locations  (blue  traces).  D:  Time-frequency  representation  of  the  ECoG 
signal  recorded  from  the  cortical  location  indicated  by  the  star  symbol  in  B.  The  time  course  of  sound  intensity  is  shown  in  black. 


al.,  2011),  or  auditory  processing  (Pasley  et  al.,  2012;  Sinai  et  al.,  2009). 
To  extract  these  amplitudes,  we  first  removed  all  frequencies  below 
0.1  Hz  from  the  ECoG  signals  using  a  high-pass  filter.  A  common  aver¬ 
age  reference  (CAR)  spatial  filter  then  removed  spatial  noise  common 
to  all  ECoG  channels.  ECoG  signals  from  each  channel  were  band  pass 
filtered  at  mu,  beta,  low  gamma,  and  high  gamma  frequency  bands 
(i.e.,  ECoG  features).  Next,  we  computed  the  magnitude  of  each  of 
these  ECoG  features,  followed  by  a  low  pass  filter  at  0.5  Hz.  Similar  re¬ 
sults  were  obtained  when  using  a  low  pass  filter  with  different  cut-off 
frequencies  (e.g.,  1  Hz  and  3  Hz).  Finally,  ECoG  signals  in  each  band 
were  downsampled  to  1 0  Hz. 

Extraction  of  sound  intensity 

We  approached  the  analysis  of  the  ECoG  correlates  of  the  song  by 
studying  its  relationship  with  the  song’s  sound  intensity.  To  do  this, 
we  calculated  the  sound  intensity  as  the  average  power  derived  from 
non-overlapping  10  ms  segments  of  the  song.  Sound  intensity  was 
smoothed  by  applying  a  low  pass  filter  at  0.5  Hz  and  then  downsampled 
to  1 0  Hz.  Fig.  3  shows  an  example  of  the  time  course  of  ECoG  high 
gamma  activity  in  temporal  cortex  derived  from  subject  B  and  illus¬ 
trates  its  relation  to  the  time  course  of  sound  intensity.  This  figure 


also  illustrates  a  time-frequency  representation  of  the  ECoG  signal 
recorded  from  the  superior  temporal  gyrus. 

Results 

Relevant  cortical  locations 

We  first  determined  the  cortical  locations  and  frequency  bands 
(i.e.,  the  ECoG  features)  that  were  related  to  sound  intensity.  To  do 
this,  we  calculated  the  pairwise  Spearman’s  correlation3  coefficient  (r) 
and  its  significance  (i.e.,  p-value)  between  sound  intensity  and  each  of 
the  different  ECoG  features  at  each  location.  The  resulted  correlation  co¬ 
efficient  (r)  has  a  t-distribution  with  df=  1798  degrees  of  freedom.  For 
those  locations  with  significant  correlation  coefficients  (i.e.,  r>0.3  and 
p-value<0.01  after  Bonferroni  correction),  we  projected  the  negative 
logarithm  of  the  corresponding  p-values  (i.e.,  —  /ogi0  (p))  onto  the 
corresponding  individual  brain  model.4  The  negative  logarithm  of  the 


3  We  used  Spearman's  (non-parametric)  correlation  method  rather  than  Pearson's 
(parametric)  correlation,  because  it  is  less  sensitive  to  outliers  in  the  data. 

4  Note  that  a  —  /ogi0  (p)  of  2  and  higher  is  statistically  significant  at  a  confidence  lev¬ 
el  of  99%  (i.e.,  p<0.01). 
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Table  2 

Correlation  coefficients  computed  between  sound  intensity  and  different  ECoG  features:  mu  (8-12  Hz),  beta  (18-24  Hz),  low  gamma  (35-45  Hz),  and  high  gamma  (70-170  Hz) 
located  over  the  posterior  part  of  the  superior  temporal  gyrus.  These  results  demonstrate  that  high  gamma  activity  yields  the  highest  correlation  in  all  subjects. 


ECoG  feature/subject 

A 

B 

C 

D 

E 

F 

G 

H 

Avg 

Mu 

-0.14 

0.1 

-0.17 

0.02 

-0.04 

-0.32 

-0.4 

-0.23 

-0.15 

Beta 

-0.13 

0.16 

-0.03 

0.11 

0.11 

-0.11 

-0.33 

-0.1 

-0.04 

Low  gamma 

0.16 

0.37 

0.31 

0.22 

0.31 

0.11 

0.30 

0.02 

0.23 

High  gamma 

0.43 

0.53 

0.45 

0.52 

0.50 

0.43 

0.51 

0.58 

0.49 

p-value  has  been  used  in  several  previous  studies  (Gunduz  et  al.,  2011 ; 
Kubanek  et  al.,  2009;  Schalk  et  al.,  2007)  to  visualize  results  from  similar 
correlation  analyses.  This  metric  is  additive,  so  it  can  be  used  to  show 
average  brain  activation  across  multiple  subjects.  The  resulting  topogra¬ 
phies  are  shown  in  Fig.  4  for  each  subject  and  ECoG  feature.  These  to¬ 
pographies  show  that  high  gamma  band  activations  in  or  close  to  the 
superior  temporal  gyrus  and  precentral  gyrus  are  significantly  correlat¬ 
ed  with  sound  intensity.  Similar  topographies  were  obtained  when  we 
applied  a  low  pass  filter  with  different  cut-off  frequencies  (e.g.,  1  Hz 
and  3  Hz)  to  each  ECoG  feature  and  sound  intensity  as  described  in 
Extraction  of  ECoG  features  and  Extraction  of  sound  intensity  sections. 

From  all  these  cortical  locations,  we  then  identified  those  locations 
in  the  superior  temporal  gyrus  and  precentral  gyrus  that  had  the  highest 
correlation  coefficients  between  ECoG  high  gamma  and  sound  intensity, 
resulting  in  two  identified  locations  for  each  subject.  (Only  subjects  A, 
D,  F,  and  G  had  locations  with  significant  correlation  coefficients  in 
precentral  gyrus.)  Across  all  subjects,  these  locations  were  tightly  clus¬ 
tered  in  the  posterior  part  of  the  superior  temporal  gyrus  and  the  dorsal 
part  of  the  precentral  gyrus,  respectively.  Table  2  shows  for  all  subjects 
the  correlation  coefficients  between  each  ECoG  feature  (mu,  beta,  low 
gamma,  and  high  gamma)  and  sound  intensity  for  the  superior  tempo¬ 
ral  gyrus  locations.  Figs.  5  and  6  show  these  cortical  locations  in  superior 
temporal  gyrus  and  precentral  gyrus,  respectively,  as  well  as  the  time 
course  of  sound  intensity  and  ECoG  high  gamma  at  the  respective  loca¬ 
tion.  Our  results  confirm  the  importance  of  these  areas  for  auditory  pro¬ 
cessing  found  in  previous  neuroimaging  studies  (Brechmann  et  al., 
2002;  Chen  et  al.,  2009;  Griffiths  and  Warren,  2002;  Hart  et  al.,  2003; 
Jancke  et  al.,  1998;  Langers  et  al.,  2007;  Popescu  et  al.,  2004;  Yetkin  et 
al.,  2004;  Zatorre  et  al.,  2007),  an  ECoG  study  (Edwards  et  al.,  2010), 
and  EEG  studies  (Mulert  et  al.,  2005). 

We  then  averaged  ECoG  high  gamma  activity  for  all  these  locations 
and  for  all  subjects  with  grids  implanted  in  the  left  hemisphere,  sepa¬ 
rately  for  superior  temporal  gyrus  and  precentral  gyrus,  and  correlated 
these  two  time  series  at  different  time  lags.  The  maximum  correlation 
coefficient  r=0.70  was  obtained  at  lag  T=110ms,  which  suggests 
that  ECoG  high  gamma  activity  in  auditory  cortex  precedes  ECoG  high 
gamma  activity  in  premotor/motor  cortex  by  1 10  ms  (Fig.  7). 

Finally,  Fig.  8  shows  the  spatial  relationship  of  the  location  identi¬ 
fied  in  precentral  gyrus  with  locations  classified  as  hand  or  face  motor 
cortex  using  electrical  stimulation  mapping  and/or  passive  functional 
ECoG  mapping  (Brunner  et  al.,  2009).  The  location  that  was  found  to 
be  related  to  auditory  stimulation  in  this  present  study  was  different 
from  hand  or  face  motor  locations  in  all  subjects. 

Discussion 

The  role  of  ECoG  gamma  activity  in  sound  processing 

This  study  shows  for  the  first  time  that  the  time  course  of  high 
gamma  ECoG  activity  is  highly  correlated  to  the  sound  intensity  of  a 
continuous  stream  of  music.  While  neural  activity  correlated  to  sound 


intensity  was  mostly  identified  in  the  superior  temporal  gyrus,  an  addi¬ 
tional  isolated  area  in  the  precentral  gyrus  also  showed  a  relationship 
with  sound  intensity  in  subjects  A,  D,  F,  and  G.  (It  is  quite  possible  that 
the  absence  of  this  location  in  the  other  subjects  can  be  attributed  to 
the  limited  spatial  resolution  of  our  recordings.)  This  area  was  not  clas¬ 
sified  as  hand  or  face  motor  cortex  using  electrical  stimulation  mapping 
or  passive  real-time  ECoG  mapping  in  any  of  these  four  subjects.  This 
suggests  then  that  the  corresponding  location  is  in  fact  related  to  a  dis¬ 
tinct  aspect  of  auditory  processing  rather  than  to  somatosensory  or 
motor  processing.  However,  future  research  is  needed  to  determine 
the  specific  functional  relevance  of  activations  in  the  precentral  gyrus 
such  as  rhythm  processing  (Zatorre  et  al.,  2007)  or  speech  processing 
(Edwards  et  al.,  2010). 

The  average  gamma  activity  in  the  superior  temporal  gyrus  was 
highly  correlated  (r=  0.70)  with  the  average  gamma  activity  from  the 
precentral  gyrus,  and  was  leading  it  by  110  ms.  These  results  might  be 
explained  by  previous  findings  in  fMRI  studies  (Chen  et  al.,  2009; 
Griffiths  and  Warren,  2002;  Popescu  et  al.,  2004;  Zatorre  et  al.,  2007) 
where  they  suggest  that  the  posterior  part  of  the  superior  temporal 
gyrus  might  act  as  a  neural  hub  decomposing  the  various  types  of 
sound  and  integrating  those  of  motor  relevance  with  the  prefrontal, 
premotor,  and  motor  regions  through  a  dorsal  pathway.  Our  results 
also  support  the  hypothesis  that  activity  in  the  high  gamma  band,  in 
contrast  to  activity  at  lower  frequencies,  co-localize  with  hemodynamic 
responses  measured  with  fMRI  during  sound  intensity  processing 
(Hermes  et  al.,  in  press;  Jancke  et  al.,  1998;  Lachaux  et  al.,  2007; 
Langers  et  al.,  2007;  Logothetis  et  al.,  2001 ).  Although  the  neurophysio¬ 
logical  origin  of  high  gamma  activity  in  ECoG  is  still  a  matter  of  some  de¬ 
bate,  recent  research  supports  the  hypothesis  that  it  is  a  reflection  of  the 
mean  firing  rate  of  the  neuronal  population  directly  beneath  the  elec¬ 
trode  contact  (Manning  et  al.,  2009;  Miller,  2010).  The  concurrence  of 
our  results  with  fMRI  studies  in  humans  and  single-unit  studies  in  pri¬ 
mates,  and  ECoG's  high  temporal  and  relatively  high  spatial  resolutions, 
strongly  encourage  further  study  of  high  gamma  ECoG  activity  and  its 
relationship  to  other  acoustic  features. 

Current  experimental  limitations 

The  present  results  are  encouraging,  and  could  not  have  readily 
been  derived  using  other  imaging  techniques.  At  the  same  time,  there 
will  ultimately  be  limits  to  what  can  be  achieved  using  the  currently 
used  subject  population.  Our  study,  like  practically  all  human  ECoG 
studies  to  date,  relied  on  electrode  grids  implanted  for  clinical  reasons. 
Thus,  grid  coverage  is  incomplete  and  variable  across  subjects.  Given 
the  limited  number  of  subjects  with  grids  implanted  over  the  right 
(1  subject)  and  left  (7  subjects)  brain  hemispheres,  further  research  is 
needed  to  determine  potential  hemispheric  differences  during  music  pro¬ 
cessing.  The  physical  and  cognitive  conditions  and  level  of  cooperation  of 
each  patient  are  impaired  and/or  variable.  In  addition,  auditory  stim¬ 
ulation  was  not  highly  controlled  during  the  experiment.  This  rela¬ 
tively  uncontrolled  experimental  situation  is  in  contrast  to  typical 


Fig.  4.  Significance  of  cortical  areas  for  sound  intensity  processing.  This  figure  shows  the  spatial  distribution  of  —  logw  (p)  values  obtained  from  the  (univariate)  correlation  between 
sound  intensity  and  each  ECoG  feature.  The  last  row  corresponds  to  the  average  spatial  distribution  of  —  logw  (p)  values  for  subjects  with  electrode  grids  implanted  only  in  the  left  brain 
hemisphere  (i.e.,  subjects  B  to  H).  Values  larger  than  2  are  statistically  significant  at  a  confidence  level  of  99%  (see  vertical  line  in  color  bar).  High  gamma  activations  are  focused  mainly 
over  the  superior  temporal  gyrus  and  precentral  gyrus. 
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30  s 


Fig.  5.  Cortical  locations  (black  dots)  in  the  posterior  part  of  the  superior  temporal  gyrus  with  the  highest  correlation  between  ECoG  high  gamma  (dashed  black  trace)  and  sound 
intensity  (blue  trace).  The  respective  correlation  coefficients,  r,  for  each  subject  are  also  given. 


neuroscientific  studies,  in  which  experimental  conditions  are  usually 
highly  controlled.  Finally,  the  subjects  in  the  study  are  epileptic  patients, 
and  thus  may  have  some  degree  of  functional  reorganization  compared 


to  healthy  individuals.  Variability  in  the  correlation  values  at  the  same 
cortical  locations  across  subjects  might  be  explained  by  variances  intro¬ 
duced  by  different  sources  such  as  grid  coverage,  physical  and  cognitive 
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Fig.  6.  Cortical  locations  (red  dots)  in  the  dorsal  part  of  the  precentral  gyrus  with  the  highest  correlation  between  ECoG  high  gamma  (dashed  red  trace)  and  sound  intensity  (blue 
trace).  (Only  subjects  A,  D,  F,  and  G  had  locations  with  significant  correlation  coefficients.)  The  respective  correlation  coefficients,  r,  for  each  subject  are  also  given. 


Fig.  7.  Left:  locations  in  the  superior  temporal  gyrus  and  precentral  gyrus  identified  in  Figs.  5  and  6.  Right:  average  time  course  of  ECoG  high  gamma  for  these  locations  in  the  superior 
temporal  gyrus  (black  trace)  and  the  precentral  gyrus  (dashed  red  trace).  Subject  A  who  has  grid  implanted  in  the  right  brain  hemisphere  was  not  considered  to  compute  the  average. 
The  corresponding  correlation  coefficient,  r,  is  also  given. 


Fig.  8.  Cortical  mapping  of  face  (red  circles)  and  hand  (yellow  circles)  motor  areas  identified  using  electrocortical  stimulation  mapping  and/or  real-time  passive  ECoG  mapping 
(Brunner  et  al.,  2009).  Coverage  of  all  other  electrodes  is  shown  using  small  black  dots.  Electrodes  in  green  are  the  same  locations  from  subjects  A,  D,  F,  and  G  shown  in  Fig.  6. 
The  brain  figure  marked  with  a  star  shows  the  MNI  brain,  the  locations  of  all  highlighted  electrodes  for  subjects  A,  D,  F,  and  G,  as  well  as  relevant  cortical  landmarks. 


848 


C.  Potes  et  al.  /  Neuroimage  61  (2012)  841-848 


conditions,  and  the  subject's  specific  neuroanatomy.  Despite  these  issues, 
the  results  presented  in  this  and  other  ECoG  studies  are  usually  consistent 
with  expectations  based  on  the  neuroanatomy  or  on  results  from  other 
imaging  modalities. 

While  the  subjects  had  a  broad  spatial  coverage,  including  coverage  of 
the  temporal  lobe,  the  analytical  detail  of  our  results  is  limited  in  spatial 
resolution  by  the  inter-electrode  distance  (0.6-1  cm)  of  the  implanted 
grids.  Grid  electrodes  with  smaller  contacts  and  inter-electrode  dis¬ 
tances  have  recently  been  implanted  and  used  to  study  language  pro¬ 
cessing  (Kellis  et  al.,  2009;  Wilson  et  al.,  2006).  Increased  resolution  of 
the  ECoG  grids  will  likely  improve  further  and  refine  our  understanding 
of  underlying  ECoG  physiology. 

The  placement  of  the  electrode  grids  in  this  study  was  based  on 
the  clinical  needs  of  the  patients  for  the  localization  of  epileptic  foci, 
which  typically  originate  from  a  single  hemisphere.  Hence,  we  could 
not  investigate  brain  lateralization  of  acoustic  processing  as  suggested 
in  Belin  et  al.  (1998);  Gourevitch  et  al.  (2008);  Platel  et  al.  (1997); 
Zatorre  and  Belin  (2001 ).  For  instance,  these  studies  demonstrated  spe¬ 
cialization  of  the  right  hemisphere  for  fine  spectral  changes  such  as  the 
pitch.  Comprehensive  access  to  both  hemispheres,  which  will  likely  re¬ 
main  impractical,  would  allow  for  a  more  complete  analysis  of  auditory 
processing. 

Future  work 

Our  study  demonstrated  the  relationship  of  ECoG  features  with 
sound  intensity  in  a  continuous  stream  of  music.  Future  work  may  in¬ 
vestigate  the  relationship  between  ECoG  features  and  other  aspects  of 
sounds  or  their  perception,  such  as  loudness  perception.  Loudness 
perception  is  a  subjective  measure  that  cannot  be  universally  measured 
by  a  single  metric  and  can  be  affected  by  several  acoustic  parameters 
such  as  sound  intensity,  bandwidth,  and  duration.  Decoding  of  per¬ 
ceived  loudness  from  brain  signals  may  have  important  applications 
for  the  calibration  of  stimulation  levels  of  cochlear  implants.  Currently, 
these  levels  are  adjusted  by  an  audiologist  and  have  to  be  frequently 
reprogrammed  due  to  implant  scar  formation  or  habituation. 
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